UIM Journal Home

Category

Research Methodology

6 articles

Lost in the Archive: The Quiet Disappearance of Scientific Raw Data and What It Costs Us

Lost in the Archive: The Quiet Disappearance of Scientific Raw Data and What It Costs Us

Studies suggest that a substantial majority of published research datasets become effectively inaccessible within five years of publication, quietly eroding the reproducibility infrastructure science depends upon. From server migrations to retired academic email addresses, the pathways to data loss are mundane yet consequential. This investigation examines the institutional failures driving the crisis and the systemic reforms that could reverse it.

Benchmarks Don't Travel: The Reproducibility Gap Threatening Machine Learning's Scientific Credibility

Benchmarks Don't Travel: The Reproducibility Gap Threatening Machine Learning's Scientific Credibility

Machine learning research has cultivated a culture of benchmark supremacy, in which state-of-the-art scores on curated datasets are mistaken for evidence of genuine, transferable capability. A growing body of methodological critique reveals that celebrated models frequently collapse under real-world conditions, raising urgent questions about documentation standards, experimental transparency, and the field's long-term scientific integrity. Drawing on lessons from psychology's replication crisis,

The Crowd and the Cosmos: How Citizen Science Is Rewriting the Rules of Research Participation

The Crowd and the Cosmos: How Citizen Science Is Rewriting the Rules of Research Participation

Citizen science — once a peripheral curiosity in the research ecosystem — has matured into a methodologically serious enterprise, with volunteer networks contributing to peer-reviewed discoveries in fields ranging from epidemiology to astrophysics. The expansion raises consequential questions about data quality, institutional recognition, and the appropriate boundaries between professional expertise and public participation. This article examines the structural forces driving the movement's grow

Transparency Without Safeguards: Examining the Unintended Costs of the Open Science Movement

Transparency Without Safeguards: Examining the Unintended Costs of the Open Science Movement

The open science movement has delivered genuine benefits to research integrity, but an honest accounting of its consequences must also reckon with the harms it has enabled — including targeted harassment of individual researchers, the chilling of exploratory inquiry, and the emergence of a methodological orthodoxy that may be narrowing science's productive range. A more calibrated approach to transparency is not a retreat from accountability; it may be its most defensible form.

Shaky Foundations: Confronting the Replication Problem Undermining Psychological Science

Shaky Foundations: Confronting the Replication Problem Undermining Psychological Science

A sweeping effort to reproduce landmark psychological findings revealed that fewer than half held up under rigorous re-examination, sending shockwaves through the discipline. The roots of this failure run deeper than individual misconduct, implicating the very incentive structures that govern academic publishing. Understanding what went wrong—and how to fix it—has become one of the most urgent methodological challenges in contemporary science.

Broken Benchmarks: How Academic AI Research Is Failing the Transition to the Real World

Broken Benchmarks: How Academic AI Research Is Failing the Transition to the Real World

A growing body of evidence suggests that a significant proportion of peer-reviewed machine learning studies cannot be replicated outside the controlled conditions in which they were produced. Methodological inconsistencies, publication bias, and the widening gap between academic benchmarks and production-grade performance are drawing urgent scrutiny from researchers and institutions alike. This investigation examines the structural forces driving AI's reproducibility crisis and profiles the scie